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INTRODUCTION 

\ 

This report presents the results ol the Washington Elementary 
Education Assessment Project (financed by Title III of the Elementary 
and Secondary Education Act) and pr-2pared for the Wdshinpton Superintendent 
of Public Instruction by the Department of Programs and Services, CTB/ 
McGraw-Hill during school year 1971-72.' 

i'h6 purposes of the project were: '1) to assess the reading and 
mathematics achievement in Washington elementary schools by sampling 
fourth and sixth grade students in randomly selected school buildings, 
2) to identify instructional objectives measured by the testing ^instru- 
ment and to determine the degree to which students are achieving those 
objectives; and 3) to determine the degree to which students are achieving 
at or near a level erpected of them. 

It should be noted that even though private schools were selected 
randomly, the student data produced in that group cannot be meaningfully 
compared to student data from other groups. No attempt was made to 
control for the fact that students attending p'i. ivate schools may be a ^ 
unique ^roup. Unaccounted variables which may or may not have produced 
the higher achievement scores in the private/parochial group include 
parent interest in the students' education (as evidenced by placement in 
private school)^aijd mean intelligence level (reported later in this 

J w 

document) - 
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DESIGN OF THE SimV 

INSTRl-MENTS 

Three instruments were administered concurrently to acquire the data needed 
for this assessment: (1) California Aahieve^.ent TestSy j9?0 Fniticn (CAT-70) , 
(2) Short Forr Test of Acaderric Artitude (SFTAA) , and (3) a fac'f sheet describing 
various school characteristics which was completed by school personnel. 

SAMPLE 

/ 

The design of the study stipulated that at least 10 percent of the 
fourth and sixth graders in at least 8 percent of the Washington elementary 
schools were to be selected as the sample for this study. Table 1 indicates 
the numbers of studertfs In both grades and the number of schools sampled 
in the state. Schools were selected randomly within two parameters: 
District Type. ^ * ' * 
ya. Urban Metropolitan — Seattle »^ Tacoma and Spokane. - 

b. Urban Non-metr9politan — urtan areas of over^l5,000 population 
which are not contiguous with any ^ban or suburban areas. 

c. Suburban — school districts contiguous with an urban area and 
primarily residential . '~ - . 

\ • ■ 

d. Rural — school district^ with less than 15,000 population ^nd 
not contiguous with any urban or suburban area. 

e. Private/Parochial — .accredited schools within the state but 
independent of the public school system. - , 

• J • •: ' . 

•2. Relative Size of District Within Each District Type. 

a. -Large. , 

b. Medium. ' , 

c. Small. ' J J 
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Table 1 



OVERALL NUMBER OF SCHOOLS 


AIJD RESPECTIVE NUMBERS 


OF STUDENTS 


IN SAMPLE 


DISTRICT TYPE • 


NUMBER OF SCHOOLS 


\jru\iJ L. H 

STUDENTS 


STUDENTS 




1 7 


1,113 


1 ,075 


Urban Non-metro 


16 


■ 1,011 • 


967 


Suburban. 


• '39 


2.738 

f 


2,562 


Rural 


36 


1,437 


1.761 


Private/Parochl^ 


19 




^9*6 . 


Total State 


127 


6,763 


6.H81 



PROCEDURES 

The Washington Elementary Educ^itlon Assessment project was an'^.ounced to 
Washington educators anci the public by the Washington State Office of Super- 
intendent of Public Instruction. One person in each district Vas designated 
to handle all aspects of the assessment program for the ^^chools in that 
district. Pre-tes6ing workshops, covering in detail all aspects of the pro- 
gram, were conducted for local personnel by a CTB/McGraw-Hlll Consultant 
prior to the testing which occurred in October* 1971. Testing was handled 
by the local ^district and results were sent to CTB/McGraw-Hlll In Monterey, 
California, for scoring, .analysis, and report writing. 
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^ AKALYSE^J 

Data from the testing were analyzed to give a comprehensive asscssricnt 

of the status of elementary education ih Washington in Reading and Mathon.it irs . 

The data were analyzed in the following ways: 

3. The achievement of Washington fourth and sixth graders, as measured 
by the CAT-70, was compared to the national - norms for this tesL. 

r 

2. The average achievement score of these Washington studertts, as ncasurcd 
by the CAT-70, was compared to their average anticipated achievencnt ^ 
score. 

Each student's anticipated achievement level was predicted fron- 
scores on the SFTAA as well as from other factors '^grade » age, sex) 
and was reported in Anticipated Achievement Grade Equivalent CMGK) ' 
units. These were averaged for the state 'iample. 

3. The distribution of students scoring significantly above and below 

^ their anticipated achievement^ was compared to the distribution of students 
in the norm group who scored above and below their expected level of 
performance. 

% 

A low ability student who may be far behind, relative to the norm, 
can be scoring' above his own anticipated achievement. Likewise, n 
high ability child can scores well above the norm but still under that 
level which is expecved of him. 

If the Washington distribution were like that of the norm proup, 
10 percent would score significantly above the anticipated achievement 
and 10 percent would score significantly below. This pattern of scores is 
called the "10-10 Distribution/* 

If favorable comparison with the norm group were the criterion for 
success, positive trends would be reflected in a Washington distribution 
with more than^ IC percent scoring above and/or less than 10 percent scoring 
below their anticipated achievement. On th^? other hand, negative trends 
wou3d result if less than 10 percent scored above and/or irore than 
lU percent scored below. 

4. School characteristics were analyzed to determine how they related 
to achievement. Fifteeii school characteristics were selected from 

^ data obtained via a fact sheet completed by school personnel, and 

from information supplied by the office of the SPI. 
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CONSIDERATIONS 



'^ile the aKaVjses reveal rian:^ 



Grade 4 and 6 populations^ caution shculd be' ucc: tc .;r.. t*/** * 

judgments about^a particular school cr dictrict, :\^:^:<r:r:' ^' 

not be made concerning cause-and-'cffect relati:Kshirs , If a Vi 1 jt : k.:^:': 

were discovered betveen achievement in c^l^'c-Jt r.rrj :v; ; ; ; 'i :r • 

it would be highly inaccurate to aso-uru? th.it the achievc'^cKt * v. ' 

the school csharact eristic. Such a rclatii-nship night, hov^?-\ r, r " ' • .* 

and provide incentive for a care fullu '("cnt rcl led studu tr. ie'.n^ 'y,* • -^^ y 

not a cause-and-effect relationship did^ zn fact, rr-'c . 

V ' achif.vjSent comparisons 

Washington "^achievement for Reading and Mathc^inatics as measured bv CAT- 70 
was compared to the national norm. For each curriculfr area, the aohicvt^nent < ! 
Washington Students was also compared to their anticipated achievement, «ind tlie \ 
distribution of anticipated achievement scores*«in Washington was compared to 
the "10-10 Distribution" of the norm" group. The major unit of measure used 
in diis analysis was the "grade equivalent." For test sc'^res, each tenth of a gradt 
equlWlent is equal to one month on the grade ecjuiv^lent* scale. For example, 
4,7 is read as fourth. grade , seventh month. 
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KLMJING * I 

The CAT-70 Reading Test is divided into two parts: Vocabulary and 
Cur^prehension. Tbe ''ocabulary s^tion' consists of AO items which indicate 
tj^e student's knowledge of the word meanings in context. A 42-itcn 
Comprehension section measures the student's understanding of vhat he reads. 
Three scores are reported: Vocabulary, Comprehension, and Total Keadin^;. \ 

Washington Distribution of Scores vs, Norn Distr4but ion ■ Figure 1 /corp.ires 
the average Reading achievement of the Washington fourth grade sanple to the 

\ 

national norm. ,In boti Vocabulary and Comprehension, the state average '*-*as 
comparable to the norm.^ In Total Reading, averages for sJl^urban and private/ 
parochial schools exceeded the norm, vhije averages for urban metro, urban 
non-metro and rural schools were comparable to the norm. The Vocabularv average 
either exceeded or was comparable to the Compreherfsion average in all district 

9 

types except rural. Private/parochial schools' average achievement was far 
above the norm and the achievement of schooj^^n the other four district types. 
This performance was not totally unexpected, however, as the mean intelligence 
quotient of this group (IQ = 105.6). was higher than the mean of the remaining 

part of the sample (IQ « 100.5). This was also true of Grade 6 Reading. 

i 

f 

Reading achievement of the Washington sixth grade sample and the national 

norm is comoared kn Figure 2. The resu^lts for the Washington sample ^hdlyed 

an average score of 6.6, five months over th^ nonr.. The average of each district 

type either exceeded the norm or was comparable to it. With few exceptions 

1 . • ■ 

the district type averages of^ the tVo reading subtests were significantly 

above the norm. 



A one month deviation from the norm is of /no practijcal significance, and 
it can be «aid, that achievement is^ comparable. In a sample of this size 
a deviation of twd months or more might be considered of some practical 
signff icance. ^ 
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VOCABULARY . COMPREHENSION 




N«110l N«1005 N»1436 N-463 N = 6725 N-llOO N=100? \ 77?^ N-143?> \ 4f'^ N«67;? 




NORM 



COMPREHENSION 




N-1053 N-987 N»2SB2 N-1761 N-495 N-68&8 



N"1056 N"987 N-2561 N«1757 U^A9S N-6856 



TOTAL READING 




i 



N« 105(1 N«987 N»2555 N - 17/54 N = 495 < N = 6841 



Figure 2 
Grade 6 Reading 



COMPARISON OF WASHINGTON ACHIEVEMENT TO NORM GROUP ACHIEVEMENT 



Washington Grade Equivalents vs. Expected Grade Equivalents * Figures 
3 and 4 compare the average anticipated reading achieve»ment and average obtained 
achievement of Grade 4 and Grade 6 of th^ Washington sample\ (See Page 4 for 
an explanation of anticipated achievement.) In regard to averages, a discrepjnry 
of^one month' is of no practical significance, (See urban metro grade 4, urban 



non-metro, gr^jde A, suburban grade 4, rural grades 4 \^nd 6, and total state 

grades 4 knd*6,) Not^e that in Grade 4, with the exceptions of the rural 

schools, anticipated and obtained achievement for each district type were 

identical in Vc^cabulary while in Comprehension the aViticlpated achievenent wis 

generally higher "than the obtained^achlevement • The only real difttrenrfs Ir, 

Grade 6 were found in higher anticipated th^n obtained ,ichlevrmen: iv. urh.in 

metro Vocabulary and (Comprehension and in urban non--meLro Comprehension. 

Washington Distribution of Percentages . Table 2 compares the per^ent.9ru^ 

of students in the Washington sample who scored above and below anticipated 
0- 

achievement with the *'10-10 Distribution" of t^e norm group. (See Page 4 for a 
^.^dlscussion of the ''10-10 Distribution.") Generally, fewer students than 
anticipated scored signif icantly^^^ove their anticipated achievement while 
slightly more than expected scored below. 

Table 2 

Grades 4 and 6 Reading ^ * 

* * 

PERCENTAGES OF STUDENTS SCORING ABOVE AND BELOW 
THEIR ANTICIPATED ACHIEVEMENT IN TOTAL READING 



DISTRICT TYPE 


GRADE 


4 


GRADE 


6 




7\ ABOVE 


7. BELOW 


% ABOVE 


% BELOW 


• 

Urban Metro 


^ 6.9 


11.1 


6.2 


li-.u. 


Urban Non-metro 


6.0 


12.4 


8.5 


10.8 


Suburban 


7.4 


11.1 


8.4 


9.1 


Rural 


" 6.0 ' 


12.0 


8.8 


9.3 


Private/Parochial 


9.0 


9.6 


8.9 


8.2 


State 


6. '9 


11.4 


8.2 


10.0 


Nonn Group _ 


10.0 


10.0 


10.0 


10.0 
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50 
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^ . ■ ' figure 3 

Grade 4 Reading 

COMPARISON OF ANTICIPATED ACHIEVEMENT TO OBTAINED ACHIEVEMENT 
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N-1028 N«d43 N-2482 N«17?8 N*493 N*6674 N t030 ^ ^43 N MHA ^\ M?'i \ v« : ^ 

ANT 6.4 6 7 6 7 6 3 7 ? 66 ANT 0 f» 7 0 ^ ^ 7 ^ 

OBT 6 2 6 8 6 7 fr2 7? 6 6 *^OB7 f > t f> 7 • s 




MATHEMATICS 



J 



• The CAT-70 Mathematics Test is divided into two parts: (1- Computation 
and (2) Concepts and Problems. The Computation subtest contiTs 68 items 
testing addition, subtraction, multiplication, and division rf whole numbers 
and fractions. The Concepts and Problems subtest consists ot 25 items measur 
ing p. still&nt*s understanding and use of mathematics concepts, plus 15 items 
dealing with word problems. 

Washington Distribution of Scores vs. Norm Distribution , Figure 5 
compares average obtained Mathematics achievement of the Wai-hington Grade A 
sample to the national norm. It is apparent that the Total ^l^thematics 
average for the state is well below the national norm as were the*averages 
of all district types except private/parochial. The performance of the 
private/parochial schools was not totally unexpected: the mean intelligence 
•quotient of this group, IQ « ^105.6, was }iigher than that of the remaining 
part of the sample, IQ » 100»5. However, the total state average for 



Concepts and Problems is comparable to the norm while the average for 
Computation is below it. Also, with the exception of {)rivate/parochial , the 
averages of all district types were well below norm in Computation while 
only two district types (urban non-metro and rural) were below norm in 
Concepts and Problems. 

A similar pattern existed in the comparison of Grade 6 obtained achieve- 
ment averages to the national^no^ (see Figure 6): all district types, t 
with the exception of private/parochial, had total math averages which 



were comparable tc or above the national no i4ille the Computation averages 
for all district types except private/parochial were below norm. 



were below 




Problems averages for all district types 




■ 5 
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NORM 

COMPUTATION CONCEPTS AND PROBLEMS 




\ 



TOTAL MATHEMATICS 




N - 1105 N - 1008 N - 2725 N « 1429 N 463 N = 6730 



FigufB S 
Grade4Mithematics 

COMPARISON OF WASHINGTON ACHIEVEMENT TO NORM GROUP ACHiEVEMENT ' 
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Figure 6 
Grade 6 Mathematics 
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COMPARISON OF WASHINGTON ACHIEVEMENT TO NORM GROUP ACHIEVEMENT 
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. Washington Grade E.qulvalents vs> Expected Grade •Equivalents . Figures 1 
and 8 compare the average anticipated Mathematics achievement to obtained 
achievement • (See Page 4 for an explana^JLon of anticipated achievemerit . ) 
With three exceptions, all bf the obtained averages for both grades were 
. significantly below anticipated achievement. 

The percentages of studer.ts in the Washington sample who scdred above 
and below anticipated achievement are compared with the '*10-10 Distribution" 
of the norm group in Table 3. (See Page 4 for a discussion of the "10-10 
Distribution;**) These percentages reveal that about cme-f ifth <as many 
students as expected scored significantly^ above expectation, while abouL 
one and a half times as many scored below. ' 



^ Table 3 

Grades 4 and* 6 Mathematics 

PERCENTAGES OF STUDENTS SCORING ABOVE AND BELOW 
THEIR ANTICIPATED ACHIEVEMENT IN TOTAL "mATHEMAT ICS 



DISTRICT TYPE 




XBADE 


4 


GRADE 


6 






% ABOVE 


% BELOW 


% ABOVE 


% BELOW 


Urban Metro 




3.8 


12.1 


2.1 


19.5 


Urban Non-rmetVo 




2.2 , 


16.7 


3.5 


20.8 


Suburban 




0.9 


17.8 


1.1 


24.2 


Rural 




1.7 


16.0 


3.1 


19.0 


Private/Parochial 




l.« 


14.9 


1.4 


18.9 


State 

Nora Group ^||p'> 




1.8 


' 16.1 • ■ 


1.4 


18.9 




,10.0 


10.0 


10.0^ 


10.0 
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SUMMARY 

The achievement data from this assessment verfe analyzed in three ways: 

1) the average achievement score of the Washington sample was compared to 

that of the national norm; 2) the average anticipated achievement score of 

the Washington sample was compared to its obtained achievement score; 3) the 

distribution of students scoring significantly above and balow their expected 

level of performance was compared to the "10-10 Distribution'*- of the norm 
Ik 

group* Tab3wS 4 and 5 indicate possible strengths and weaknesses revealed 
in Reading and Mathematics, respectively, through each of the above com- 
parisons* The possible strengths and weaknesses revealed in each con^parison 
are represented in Tables A and 5 by the following symbols: 



Comparison 1: Washington Achievement vs. Norm Achievement 

+ at least 2 months above the norm 
(po§sible strength) 

0 «= + 1 month from the norm ' 

- * at least 2 months below the norm 
(possible weakness) 

Comparison 2: Anticipated Achievement vs. Obtained Achievement 

+ « obtained achievement at least 2 months f 
greater than anticipated achievement 
(possible strength) 

0 » + 1 month's difference in obtained and 
anticipated achievement 

• » anticipated achievement at least 2 months 
greater than obtained achievement 
ir (possible weakness) 



Comparison 3: 



Washington Di'-cribution vs. *'10-10 Distribution 



a positive distribution based on at least 13 percent 
of the students scoring above their anticipated 
achievement and 7 percent or l^iiss of the students 
scoring below their anticipatied achievement 



0 = 



an 



tlcipated distribution 



- = a negative distribution based on 7 percent or less 
of the students scoring above their anticipated 
achievement and at least 13 percent of the students 
scoring below their anticipated achievement 

In all comparisons, a one month deviation above or below the norm is 
of no practical significance. 
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RELATIONSHIPS BK .WEEN SCHOOL CHARACTERISTICS AND ACHIEVEMENT 

An analysis WiS made to identify relationships between character isti 
of the schools and achievement test scores. School characteristics were 
determined from a fact sheet completed by school personnel and from infor 
mation supplied by the office of the 5PI, The analysis reveiled little 
quantitative relationship at either grade between achievement and school 
characteristics. 

»^ 

Information was collected on the following characteristics: 
I* District enrollment, 
2* School enrollment. 

3, Staff weighting factor (an index of staff qualifications based 
on preparation and teaching experience) < 

4- Per pupil expenditure, 

5, Average time spent in teaching Reading to Grades 1, 2, 3, 4, 5, 
and 6 . 

6, Average time spent in teaching Mathematic^s to Grades 1, 2, 3, 4, 
5, and 6. 

7, Time spent by special reading personnel in a building. 

8, Average amount of "pupil free" time given to teachers each day, 

9, Basic system used to group children for reading instruction-, 

10. Basic system used to pace children through their reading program 

11. Basic system used to group children for mathematics instruction. 

12. Basic system used to pace children through their mathematics 
program, 

13 ♦ Teacher «inobility factor (based upon the percentage of teachers 
leaving a building over the past three years), 

14. Pupil/teach^ ratio, 

15. Pupil/adult ratio (Includes teacher aides), 
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Analysis of Student Achiev eaent on CAT- 70 Reaiing Objectives 

The items in Level 3 of. the Reading Test were c.iteporized Intf^ ten 
objectives (see Table 6) • 

In the analysis of the data, an attempt was made to determiV.e the 

degree of attainment of each of the objectives by district type. The 

percentage of correct Iten response^vas deternTined for the Washington 

t f 

Grade 4 ^nd Grade 6 sample. The objectives wert^ then ranked froir. highest 
percent achievement to lowest percent achiijvement by the total state 
sample. 

It should be noted that the data reported in this section is slrply 
reporting what percentage of students in each district type and totaJ 
state reached a pr e-deternined criterion for the objective. Caution 
should be used in analyzing 'this information. A low percentage of students 
reaching a given objective should not be immediately construed as a negative 
result, as that objective may not be appropriate for that grade level- 
However, if the particular objective is considered valid for a given grade 
level and few students reach the objective, thea further analysis may be 
indicated • 

Tables 7 and 8 show the degree of attainment of each objective ranked 
in order from most to least in the Washington sample, Reading, Grades 4 and 6. 
They allow for a determination of degree of attainment of each objective by 
district type. • ' 

^Correct item ipsponse is defined as ^the relationship of correct a«ftswer8 to 
possible corref^*: answers. For example,* if an objective is measured by 5 items 
and 500 pupils riespond to this objective, then there are 5 x 500 « 2,500 
possible correct answers. If there were 2,000 correct answers, the percentage 
of correct item response is 80%. This can also be looked at as the average 
number of students responding correctly 'to items measuring the objjej^tive. ^ 

N 
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For example, Table 7 (Grade A, Reading) shows the objective reached by 
the largest percentage of students in the total state sample (79%) — Objective 
Nq. ?• (The student will be able to complete a sentence about th^ information 
in a given table of contents). The objective reached by the lowest percentage 
of students (27%) was Objective No. 6. (The student will be lable to recognize 
the author's purpose in writing a given passage by completing a sentence^. 

If these two objectives are accept^ as valid objectives for the fourth 
grade, then greater concern for the students' performance regarding Objective 
No. 6 would be vTarranted than for Objective No. 7. However, recalling an 
earlier caution than the instrument used was not designed for this type of 
criterion-referenced analysis, another factor should be considered. 

The far right-hand column shown in parenthesis lists the norm percentage 
of correc|t item response. Relative to norm performance, Washington students 
performed approximately the same on both Objective No. 6 and Objective No. 7. 
(Objective No. 6 — Washington students «, 27%, norm * 31%:; Objective No. 7 — 
Washington students « 79%, norm ■ 80%). Therefore, in a norm-referenced 
frame, Washington students s^ampled are achieving the two particular objectives 
at about the same level as the norm group. But from a criterion-referenced 
frame, the performance on the two objectives differed significantly. 



Table 6 



Reading Objectives, CAT-70, Level 3 



1. The student will be able to choose the best meaning for a given 
word in a short phrase. 

2. The student will demonstrate his ability to recall story facts 
from a passage by completing a sentence or answering a question. . 

t 3. The student will demonstrate his ability to make an inference or 
• draw a conclusion from information given in a story or chart by 
completing a sentence or answering a question. 

4* The student will be able to identify the cause for a given effect* 

5. The student will be able to choose the main idea of paragraphs 
he has read by completing a sentence. ^ 

6. The student will be able to recognize the author's purpose in 
writing a given ],assa.ge by completing a sentence. 

7. The student will be able to complete a sentence about the 
information in a given table of contents. 

8. The student will be able tc complete a sentence about the 
information in a given index. 

9. The student will demonstrate his ability to read and interpret 
charts and symbols by completing a sentence. 

10. The' student will be able to choose t\\e main idea of a passage 
he has read. . 



I 

i 
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Table 7 
Grade 4, Reading 







Percentage Correct 


JULcIu AcapunotS 




- LX Vc 




Obj. 


Urban 


Urban 






Private/ 


Total 




No • 


Mp ^ rn 


i^VJlt ilC L 1. «J 


^ 1 1 K 1 1 T" K Jl 




jraLUl^liXoX 


^ f a ^ <> 


4.\U 1 11' 


7 


77 


• 

76 


81 


77 




79 


f8n> 

VOL* } 


10 


77 


74 


79 


77 
# # 


85 


78 


V O J / 


g 


58 


56 


61 


59 


12 


60 


vou ) 


2 




51 


56 


54 


63 


54 


(59) 


1 


43 


47 


47 


41 


55 


46 


(53) 


9 


37 


40 


41 


40 


50 


41 


(49) 


3 


37 


36 


39 


38 


41 


38 


(40) 


A 


' 33 


35 


37 


36 


38 


36 


(37) 


5 


28 


'27 


30 


29 


35 


29 


(32) 
















6 


24 


' 29 


27 


27 


28 


27 


(31) 



Table 8 



Grade 6, Reading 
Percentage Correct Item Response for Each Objective 



r 



Obj, 
No* 


• Urban 
Metro 


Urban 
Non-Metro 


Suburban 


Rural 


Private/ 
Parochial 


Total 
State 


Norm 


/ 


91 


93 


93 


91 ^ 


95 


92 


(90) 


10 


89 


90 


92 


90 


96 


69 


(89) 


8 


77 

r 


79 


80 


76 


66 


79 


(81) 


2 


70 


73 


76 


73 


62 


74 


<74) 


1 


>67 


75 




67 


60 


72 


(73) 


9 


62 . 

4 


67 


67 


65 


73 


66 


(66) 




52 


■ 58 


60 


56 


66 


56 


(51) 


3 


54 


57 


58 


56 


63 


57 


(57) 


6 


39 


44 


44 


42 


49 


43 


(44) 


5 


38 


41 


» 43 


40 


46 


41 


(41) 




Analysis of Student Achievement on CAT-70 Mathematics Objectives , 

-y^The Items In Level 3 of the Mathematics Test were* categorized Into 
.twenty-six objectives (see Table 9) . / 

In the analysis of the data, an attempt was made to determine the 
degree of attainment of each of the objectives by district type. The 
percentage of correct Item response\^as determined for the Washington 
Grade 4 and Grade \ sample. The objectives were then ranked from highest 
percent 'achievement to lowest percent achievement by the total state 
sample • 

It should be noted that the data reported In this section Is simply 
reporting what percentage of students In each district type and total 
state reached a pre-determlned criterion for the objective. Caution 
should be used In analyzing this Information. A low percentkge of students 
reaching a given objective should not be Immediately conattued as a negative 
result, as that objective may not be appropriate for that grade level. 
However,* If the particular objective Is considered valid for a given grade 
level and few students reach the objective, then further analysis may^be 
indicated,. • ^ 

Tables' 10 and 11 show the degree of attainment of each objective raftked . 

In order from most to least In the Washington sample. Mathematics, Grade 4 and 6. 
« 

They allow for a determination of degree of attainment of each objective by 
district type. 



^Correct item response %^ defined as the relationship of correct answers to 
possible correct apswers. For example. If an objective Is measured by 5 Items 
and 500 pupils respond to this objective, then there are 5 x 500 « 2,500 
possible correct answers. If there were 2,000 correct answers, the percentage 
of correct item response Is 80%. This can also be looked at as the average 
number of students responding correctly to items measuring the objective. 
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For example. Table 10 (Grade 4, Mathematics) shows the objective 
reached by the largest percentage of students on the total state san;pl\^ 
(93%) — Objective No. 15. (The student will be able to answer a question 
by reading a graph or any calibrated measuring ins tr urgent ) . The objective 
reached by the lowest percentage of students (25%) was Objective No. 25* 
(The student will be able to multiply two niin:bers when at least one factor* 
is a fraction or a mixed number). 

If these two objectives are accepted as valid fourth grade objectives, 
then greater concern for student performance on Objective No. 21. would be 
warranted than for Objective No. 15. However, recalling an earlier caution, 
the instrument was not designed for this type of criterion-refereYice analysis, 
thus another factor should be considered. 

The far right-hand column shown in parenthesis lists the norm percentage 
of correct item response. Relative to norm performance, Washington students 
performed at approximately the norm on Objective No. 15 (Washington students = 
93%; norm = 91%). However, on Objective No. 25 Washington students scored at 
about one-half of the norm (Washington students 25%; norm A8%). 

By providing the norm reference, this allows for a determination of the 
discrepancy between Washington student achievement and the norm group. However, 
the basic analysis of the objectives is the identification of the actual degree 
of achievement of the objectives measured by the CAT-70. 
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Table 9 

Mathematics Objectives, CAT-70, Level 3 



1, The student will be able to add numbers with as nany as two digits, 
with or without regroupin^^ 

2, The student will be able to subtract numbers with as many as two digits 
with or without regrouping, ^ 

3, The student will be able to add three or four digit numbers, with or 
without regrouping, 

4, The student will be able to subtract three or four digit numbers with 
or without regrouping, . 

m 

5, The student will be able to multiply numbers with as many as two digits 
by numbers with one digit, 

6, The student will be able to divide numbers with as many as two digits 
by numbers with one digit, 

7, The student will be abJe to multiply numbers with three or four digits 
by numbers with up to three digits, 

8, The student will be able to divide numbers with three or four digits 
by nur.ibers with up to three digits, 

9, The student will be able to add or subtract numbers representing amounts 
of money or lengths of measure, • ^ 

10, The student will be able to multiply or divide numbers representing 
amounts of money or lengths of time, 

11, The student will be able to match a mathematics symbol or abbreviation 
to its word name, 

12, The student will be able to supply a missing numeral in a simple 
equation, 

• 

13, The student will be able to answer a question concerning a plane 
geometric figure (such as, choosing the longest line segment). 

14, The student will be able to match a numbe;: or an amount of money 
written in words to its numeric expression, 

15, The student will be able to answer a question by reading a graph 
or any calibrated measuring instrument, 

16, The student will be able to convert a specified quantity from one 
form to another (such as feet to inches or percent to fraction). 



-30- 



/ 



17. The student will be able Co convert a Roman numeral to a basL-t^n 
numeral. / 

18. The student will be able to answer a question showing his under- 
standing of place value or digit value in the base-ten number system. 

19. The student will be able to solve a on^-step word problem using ^ 
addition, subtraction, -multiplication and/or division. 

20. The student will be able, to solve a two-step word problem using 
addition, subtraction, multiplication and/or division. 

21. The student v;ill be able to ^olye a word problem involving the 
additioh and/or subtraction of amounts of money. 

22. The student will be able to solve a word problem in which he finds 
the average of two or more numbers. 

23. The student will be able to add two numbers when at least one addend 
is a fraction or a mixed number. 

24. The student will be able to subtract two numbers when at least one 
term is a fraction or a mixed number. 

25. The student will be able to multiply two numbers when at least one 
factor is a fraction or a mixed number. 

26. The student will be able to divide two numbers when at least one 
term is a fraction or a mixed number. 
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Table 10 



Grade 4, Mathematics 





• 


Percentage 


Correct Item 


Response 


for Each Objective 






Obj. 
No. 


Urbr>n 
Metro 


Urban 
Non-Metro 


Suburban 


Rural 


Private/ 
Parochial 


Total 
State 


Norm 


13 


92 


92 


93 


92 


96 


93 


(91) 


1 


91 


92 


92 


92 


93 


92 


(93) 


11 


89 


89 


89 


87 


91 


89 


(89) 


3 


86 


85 


87 


86 


90 


87 


(89) 


2 ' 


- 85 


• 86 


87 


• 86 


90 


86 


(90) 


6 


86 


86 


87 


85 


92 


86 


(93) 


12 


81 


84 


84 


83 


88 


83 


(83) 


4. 


-^79 


81 


82 


82 


87 


82 


(86) 


5 


80 


81 


82 


82 


88 


82 


(86) 


17 


73 


72 


71 


78 


83 


74 


(78) 


18 


72 


'77 


74 


72 


77 


74: 


(73) 


20 


72 

/ 


77 


74 


72 


79 


74 


(73) 


14 


73 


73 


71 


70 


78 


72 


(71) 


19. 




74 


72 


70 


^6 


72 


(71) 


21 


68 


70 


69 


68 


V3 


69 


(68) 


7 


86 


76 


67 


.65 
68 


75 


67 


(73) 


9, 


87 


66 


67 


70 


67 


(74) 


10 


65 


63 


62 


63 


71 


63 


(73) 


24 


48 


i3 


52 


52 ,. 


53 


52 


(68) 


8 

• 


50 


51 . 


51 


50 


63 


51 


(64) 


13 


49 


46 


47 


44 


53 


47 


(49) 


'23 


51 


46 


46 


47 


49 


47 


(64) 


22 


44 


41 


35 


34 


41 


37 


(49) 


_16 


36 


34 


,34' 


32 , 




34 


(42) 


26 


26. 


29 


26 


26 


28 


27 


(42) 


O 25 


25 


28 


23 . 


25 


.25 


25 


(48) 
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Table 11 



Grade 6, Mathematics 
Percentage Correct Item Response for Each Objective 



f 



Obj . 
No. 


Urban 
Metro 


Urban 
Non-Ketro 


Suburban 


Rural 


Private/ 
Parochial 


Total 
State 


Norm 


1 


82 


83 


83 


84 


88 


83 


(87) 


15 


77 


75 


78 


77 


83 


78 


(80) 


3 


75 


72 


74 


74 


76 


74 


(80) 


2 


72 


68 


68 


70 


73 


69 


(79) 


A 


68 


65 


66 


68 


72 


67 


• (76) 


11 


67 


59 


63 


61 


70 


63 


(77) 


12 


59 


60 


64 


61 


74 


63 


(73) 


19 


52 


51 


53 


52 


58 


5'i 


(58) 


20 


52 


50 


53 


49 


56 


52 


(54) 


17 


51 


45 


48 


53 


59 


50 


(56) 


18 


Ad 


48 


49 ' 


48 


51 


4'8 


(55) 


lA 


50 


46 


48 


47 


58 


48 


(58) 


21 


A5 


.45 


46 


46 


49 


A5 


(49) 


6 


A3 


39 


^3 


. 44 


57 


AA 


(72) 


9 


A7 


41 


42 


44 


A9 


AA 


(5A) 


5 


A2 


38 


40 


'41 


46 


Al 


(71) 


2A 


36 


- 34 


35 


37 


35 


36 


. (39) 

V 
\ 


23 


31 


29 


31 


32 


30 


31 


(33) 


7 


27 


25 


27 


27 


40 


27 „ 


(47) 


13 


24 


21 


23 


23 


26 


-23 


(30) 


10 


20 


17 


18 


19 


20 


18 


(A2) 


26 


17 


17 


16 


21 


18 


17 


(21) 


25 


14 


13 


13 


13 


14 


lA 


(14) 


8 


13 


12 


13 


12 


14 . 


13 


(27) 


16 


13 


11 


11 


11 


12 


12 


(19) 


22 


13 


13 


12 


9 


11 


12 


(15) 



CONCLUSIONS 



Six T\iain conclusions can be drawn from the results of thi? a5;.ses5;r.ent ■ 

1. The Washington students generally performed comparable to rr , 
above the national norm in Reading and below the national norr. 
in Mathematics in both grades. 

2* The Washington fourth and sixth graders generally scored as Tnti- 
cipated in Reading and significantly b-elov what was expoctcd of 
them in Mathematics. 

3. In Mathematics, the averages in the Concepts and Problerris subtest 
were generally higher than those of the Computation subtest. This 
was more pronounced in Grade 6 than in Grsde A. 

4. The proportions of students vho scored t jgnif icantly above and 
below their anticipated achievement was generally less favorable 
than the norm In mathematics. 

5. Comparing the five district types to one another, the pr ivate/parocbi a 1 
schools ranked first in both grades in Reading an^^. Mathenatlcs 

(see Page 1 for a possible explanation of this situation) and 
Suburban schools ranked second in Reading in Grades A and 6. 
Beyond that point the performance of the remaining districts 
was comparable. 

6. Little relationship existed between school characteristics and 
achievement.^ 



KEXT STEPS FOR A SCHOOL DISTRICT 



GIVEN: 

(Mathem.it ics) 
'.QUESTIONS: 



The data indicates that students may be weak in 
computational ski lis. 



1)0 yrHi have r irrent data with respect to mathe- 
matics achievement on your student population? 

a. i)o your students follov^ the trend in com- 
PMtat ional skills? 

b< Do your students follow the trend in concepts 
and problem solving?" 

c. Are the objectives (listed on pages 30-31 and 
analyzed on pages 32-33), appropriate to grades 
^ and 6 in your school district? 

d. Do you know how well your students are performing; 
on those o^bjeYt'lves which you consider appropriate? 



GIVEN: 
(Reading) 

QU ESTION S: 



The data indicates that more studehts scored below 
their anticipated level in Reading than was expected 



i>o you have current data with respec" to reading 
achievement on your student population? 

a. Do your students follow the trend in vocabulary? 

b. iJo your students follow the trend in cor4>re- 
hension? 

c. Are the objectives (listed on page 25 and 
analyzed on pages 26-27) appropriate to 
grades 4 and 6 in your school district? 

d. Do you know how we J] your students are performing 
on those objectives which you consider appropriate? 
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NEXT STEPS FOR A SCHOOL DISTRICT — * onLinued 



ACTION: Several steps should be considered hof ore vou r.ove In hi 

effort to increase the effectiveness of vour pr o^ra-^. . 

1, If you do not have current data, you should col If* t it. 

If you discover areas of weakness, you sn(vj](i i uvt-s t i ^ ; 
alternatives aired at strengthening; tht^se weakne«isi's . 

3. In your attempt to strengthen areas of weakness, v<^ii 
should uc particularly cautious that in so doing vcmj jr x 
not jeopardizing another area, 

4. In your investigation of alternatives you might want 
^ to consider one or more of the following: 

increased emphasi s 
'increased time allocation 
new or diTferent materials 
inc reased use of games 
more manipulat ives 
alternative teaching stralt-gies 
cross ago tutoring 
inservice for teachers 
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